Objective Bayes Factors for Gaussian Directed Acyclic Graphical Models
نویسندگان
چکیده
We propose an objective Bayesian method for the comparison of all Gaussian directed acyclic graphical models defined on a given set of variables. The method, which is based on the notion of fractional Bayes factor, requires a single default (typically improper) prior on the space of unconstrained covariance matrices, together with a prior sample size hyper-parameter, which can be set to its minimal value. We show that our approach produces genuine Bayes factors. The implied prior on the concentration matrix of any complete graph is a data-dependent Wishart distribution, and this in turn guarantees that Markov equivalent graphs are scored with the same marginal likelihood. We specialize our results to the smaller class of Gaussian decomposable undirected graphical models, and show that in this case they coincide with those recently obtained using limiting versions of hyper-inverse Wishart distributions as priors on the graph-constrained covariance matrices.
منابع مشابه
NON LOCAL ALTERNATIVE PRIORS FOR GAUSSIAN DIRECTED ACYCLIC GRAPHICAL MODELS Revised Version
Prior choice for Bayesian model comparison can be problematic for several reasons. In particular, for the comparison of two nested models, it was recently pointed out that typical prior choices may produce an unsatisfactory learning behavior of the Bayes factor. More in detail, if the sub-model is not true the accumulation of evidence is exponentially fast in favor of the encompassing model, wh...
متن کاملThe Letac-Massam conjecture and existence of high dimensional Bayes estimators for Graphical Models
The Wishart distribution, defined on the open convex positive definite cone, plays a central role in multivariate analysis and multivariate distribution theory. Its domain of integrability is often referred to as the Gindikin set. In recent years, a variety of useful extensions of the Wishart have been proposed in the literature for the purposes of studying Markov random fields / graphical mode...
متن کاملFitting Directed Graphical Gaussian Models with One Hidden Variable
We discuss directed acyclic graph (DAG) models to represent the independence structure of linear Gaussian systems with continuous variables: such models can be interpreted as a set of recursive univariate regressions. Then we consider Gaussian models in which one of the variables is not observed and we show how the incomplete log-likelihood of the observed data can be maximized using the EM. As...
متن کاملParameter Priors for Directed Acyclic Graphical
We develop simple methods for constructing parameter priors for model choice among Directed Acyclic Graphical (DAG) models. In particular, we introduce several assumptions that permit the construction of parameter priors for a large number of DAG models from a small set of assessments. We then present a method for directly computing the marginal likelihood of every DAG model given a random samp...
متن کاملLearning Markov Equivalence Classes of Directed Acyclic Graphs: an Objective Bayes Approach
A Markov equivalence class contains all the Directed Acyclic Graphs (DAGs) encoding the same conditional independencies, and is represented by a Completed Partially Directed DAG (CPDAG), also named Essential Graph (EG). We approach the problem of model selection among noncausal sparse Gaussian DAGs by directly scoring EGs, using an objective Bayes method. Specifically, we construct objective pr...
متن کامل